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Abstract 

We examine the (3+l)-class of 4-neutrino mass spectra within a rigorous statisti- 
cal analysis based on the Bayesian approach to probability. The data of the Bugey, 
CDHS and KARMEN experiments are combined by using a likelihood function. 
Our statistical approach allows us to incorporate solar and atmospheric neutrino 
data and also the result of the CHOOZ experiment via inequalities which involve 
elements of the neutrino mixing matrix and are derived from these data. For any 
short-baseline Am^ we calculate a bound on the LSND transition amplitude A^;e 
and find that, in the AmP-A^.f. plane, there is no overlap between the 99% CL 
region allowed by the latest LSND analysis and the region allowed by our bound on 
y4.^;e at 95% CL; there are some small overlap regions if we take the bound at 99% 
CL. Therefore, we conclude that, with the existing data, the (3-|-l)-neutrino mass 
spectra are not very likely. However, treating the (2-|-2)-spectra with our method, 
we find that they are well compatible with all data. 
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1 Introduction 



At present, there are three indications in favour of neutrino oscillations namely the 

solar z/e deficit p|, the atmospheric 0, |] deficit and the result of the LSND experiment 

P, ^ hinting at ''v\-^^Ve transitions. Whereas in the case of the first two indications several 
experiments agree on the existence of the effect, the third indication is found only by the 
LSND collaboration. Therefore, in many analyses the LSND result is left out. However, 
if all three indications in favour of neutrino oscillations are confirmed, for three mass- 
squared differences of different orders of magnitude (10~^° eV^ < Amg^jg^j, < 10~^ eV^ or 
Arrig^jg^j, ~ 10~^ eV^, Am^^^^ ~ 3 x 10"'^ eV^, AmLg^D ~ 1 ^V^) one needs a minimum of 
four neutrinos, three active ones and a sterile one 0. In that case a major revision of our 
picture of the lepton sector of the elementary particles would be necessary, with a mixing 
between the active and the sterile neutrinos; i.e., 



VaL = ^"i with a = e, /i, r, s, (1) 
i=i 

if we stick to the minimum of four neutrinos. In Eq. (|l|) the left-handed flavour fields are 
denoted by Uai and the left-handed mass eigenfields by pjl, and the 4x4 neutrino mixing 
matrix U is assumed to be unitary. 

One of the most important issues in the context of 4-neutrino scenarios is the question 
of the 4-neutrino mass spectrum p, |^, . There are two different spectral classes with 



very different properties: the first class contains four types and consists of spectra where 
three neutrino masses are clustered together, whereas the fourth mass is separated from 
the cluster by the mass gap needed to reproduce the LSND result;[] the second class has 
two types where two pairs of nearly degenerate masses are separated by the LSND gap. 
These two classes have been dubbed (3-1-1) and (2-|-2)-neutrino mass spectra, respectively 



11|. The main difference between these two classes is that, if a (2-|-2)-spectrum is realized 
in nature, the transition into the sterile neutrino is a solution of either the solar or the 
atmospheric neutrino problem, or the sterile neutrino has to take part in both, whereas 
with a (3-M)-spectrum it could be only slightly mixed with the active neutrinos and 
mainly provide a description of the LSND result. 

It has been argued in the literature |^, 0, that the (3-1-1 )-spectra are strongly 
disfavoured by the data, whereas the (2-|-2)-spectra are the preferred ones, in agreement 
with all data showing evidence for neutrino oscillations and also with those where no such 



evidence has been found. Recently, in Refs. ||Tl|, |T^, |T^ this statement has been challenged 
because in the latest LSND analysis the allowed region in the Am^-An-e plane, where 
A^-e is the LSND transition amplitude, has undergone a slight shift towards smaller mass- 
squared differences, which makes the (3-|-l)-spectra somewhat less disfavoured. Further- 
more, in a 2-neutrino analysis of atmospheric neutrino oscillations the Super-Kamiokande 
data prefer Vj. conversion over — > Vs Jill- Moreover, there is some debate also in 



the solar neutrino problem whether the z/g — > transition is disfavoured in comparison 
with other solutions [|1^, though such a feature seems not to be borne out by a global 
analysis of the data In any case, moving away from pure 2-neutrino considerations 

^This class contains the hierarchical mass spectrum. 
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in the solar and atmospheric neutrino problems, transitions into active-sterile superposi- 



tions |T^, |T9| give viable solutions to both problems within the (2+2)-spectral schemes, 
with features which will be tested in the future 
The arguments presented in Refs. M, 



T0[] , which disfavour the (3+l)-mass spectra. 



are based on exclusion curves from short-baseline (SBL) experiments, and solar and at- 
mospheric neutrino data enter into this simplified analysis only through inequalities. The 
advantage of this approach is that its parameters are confined to the quantities^ 



dn 



\U, 



(a 



(2) 



and the SBL or LSND mass-squared difference Am^. For definiteness we assume that the 
mass separated by the LSND gap is and, therefore, Am^ = \m1 — m 



It has turned 

out that the up-down asymmetry of atmospheric multi-GeV /x-like events measured in the 
Super-Kamiokande experiment 



is very suitable to constrain |]T0 



solar data it follows that de must be small. The probability of SBL 
given by the two-neutrino-like formula M 



whereas from the 
Up transitions is 



A^-e sin^ 



Am^L 
AE ' 



(3) 



where L is the distance between source and detector and E is the neutrino energy and 



A 



fj,;e 



4 dgd^ . 



(4) 



The LSND experiment gives an allowed region in the Am^-A^;e plane. 



However, the arguments of Refs. |^, are not based on a well-defined statistical 
procedure. Therefore, they remain on a semi- quantitative level and do not allow to assess a 
confidence level (CL) which quantifies the degree at which the (3-|-l)-spectra are excluded. 

In this paper we make a step forward towards such an assessment. The main points 
to achieve our goal are the following: 

• The aim is to arrive, for every SBL mass-squared difference Am? , at a probability 
distribution solely in terms of d^ and d^; a suitable method for this purpose is given 
by the likelihood function in combination with the Bayesian approach (see, e.g., 
Refs. 0, 0). 



We make full use of the data of the SBL Bugey CDHS ^ and KARMEN 
[ p^ , |27[] experiments through the likelihood function. 



In the spirit of Refs. |TU|, all information pertaining to the atmospheric and 
solar mass-squared differences is included via inequalities. Within our probabilistic 
framework we are able to treat inequalities as prior probabilities or with a kind of 
a maximum likelihood method. 

In this way we treat the inequality following from the atmospheric up-down asym- 



metry and, similarly, we include also the result of the CHOOZ experiment ||2^; the 
solar neutrino data allow a simpler treatment in the context of the Bugey data , 
as described in Refs. p, . 

^Note that in Rcf. the quantities Ca — 1 — da are used instead. 
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• Eventually, for every given SBL Am? and any CL /3, we are able to calculate an 
upper bound 74°(Am^) on the transition amplitude A^.g, and we can compare such 
bounds 74°(Am^) with the 90% and 99% CL regions in the Am^-A^.g plane found 
by the LSND experiment Q. 

In the same framework we will also discuss the (2+2)-spectra. 

The plan of the paper is as follows. In Section ^ we rederive the atmospheric up-down 
inequality [1^ in a form which is suitable for our purpose. In Section |^ we introduce the 



likelihood function and the Bayesian approach, and describe how to incorporate inequal- 
ities; we apply the methods developed there to the CHOOZ result and the atmospheric 
up-down inequality. In Section H we explain how we calculate bounds on A^.g and discuss 
each of the SBL experiments we use, together with their features which are important in 
this context. Details of technical nature are deferred to the appendix. Our main result, 
represented as a plot in the Am^-A^^e plane, is also given in this section. In Section ^ we 
consider the (2-|-2)-spectra in the framework of our statistical approach and in Section |] 
we draw our conclusions. 



2 The atmospheric up-down asymmetry as a con- 
straint on short-basehne neutrino oscillations 

The most convincing evidence for disappearance in atmospheric neutrino experiments 
is given by the so-called up-down asymmetry 

A.. = ^ (5) 

measured by the Super-Kamiokande Collaboration |^ , where U and D refer to the number 
of up-going and down-going //-like multi-GeV events, respectively. Quoting the number 
for fully contained events, after 1289 days of operation the result 

A;;^p = -0.327 ± 0.045 ± 0.004 (6) 



was found [^. Adding statistical and systematic error in quadrature, one obtains 

AAr/ = a^ = 0.045. (7) 

Because of the smallness of the systematic error this value is identical with the statistical 
error. 

Let us now rederive the atmospheric up-down inequality . In the following we will 
not indicate antineutrinos but our arguments will hold for both, neutrinos and antineu- 
trinos. With the assumption that downward-going atmospheric neutrinos do not oscillate 
with the frequency associated with Am^^j^ and that oscillations according to Am^ are 
averaged out, we obtain 

= dl + (1 - daf and P!^^^ = -A..e . (8) 
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Denoting the number of muon (electron) neutrinos and antineutrinos produced in the 
atmosphere by rz.^ [ne), it follows from Eq. (^) that 

D = n^[dl + (1 - d^f] + ]^neA^,, . (9) 



For the upward-going neutrinos we have the inequalities 



P!^^^ > dl and P^^^ > ^A..^ . (10) 



1 



We, therefore, have the inequahty 

1 
4 



4 



U > n^dl + -n,A^,, . (11) 



Note that for the (3+l)-spectra the amplitude A^.^ is given by Eq. (|[). Since —A^^ (^ is 
a monotonously decreasing function in [/, using Eqs. (P) and (11) we obtain the so-called 
up-down inequality for /x-like atmospheric events 

- < G{d,, d.) = , , . (12) 

^ (1 - d^)-^ + 2dl + 'id^d^.jr ^ ^ 

In this equation we have defined r = ny^jrif,. The numerical value r ~ 2.8 can be read off 
from Fig. 3 in Ref. of the Super-Kamiokande Collaboration. With similar arguments 
one can also find an upper bound 

A., < Hid., d,) = "^'^j'/i'ifi" ■ (13) 
1 - d^(l - df,) +dedf,/r 

Hence, the up-down asymmetry is confined to the interval 

-G<A^^<H. (14) 
Some remarks are at order. Our inequality (|I^) is a little different from the analogous 



inequality in Ref. |]T0|, because in the present case we have not eliminated de] this is 
useful because our aim is to derive a probability distribution in d. and d^ (see next 
section). The ratio r has a slight dependence on the atmospheric zenith angle which is 



neglected here; however, since d. is confined to rather small values [H, Urn by the result of 



the Bugey experiment ||23|, the terms containing r are rather unimportant numerically. 



The assumptions for deriving Eqs. (0) and (13) are not exactly fulfilled: for down-going 
neutrinos with zenith angles around 0°, oscillations according to small SBL mass-squared 
differences Am? around 0.2 eV^ are not completely averaged out; for down- going neutrinos 
with zenith angles close to 90°, oscillations according to Am^^^^ do occur already, if the 
atmospheric mass-squared difference is large. We have checked that both effects do not 
change numerically the bound G by more than a few percent in the worst case. Finally, 
matter effects, which are important for up-going neutrinos, do not affect the inequalities 
(|T0|) and thus also not the inequality for U . Eq. (|12D is, therefore, a well-established 
inequality which restricts mainly the allowed range of d^. Due to Eq. (^), it will be used 
in the following to constrain the SBL amplitude v4^;e- 
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3 The statistical treatment of inequalities 



As mentioned in the introduction, a suitable method for the purpose of deriving a proba- 
bihty distribution in the variables and (i^ is given by the likelihood function combined 
with the Bayesian approach, which is defined as follows. Suppose one has a series of mea- 
surements X = (xi, . . . , Xn) and r parameters 6 = {9i, . . . ,9r) to be estimated. Then the 
Bayesian approach allows to construct a "posterior" probability density in the parameter 



space via (see, e.g., Ref. [EG, 21 



In this expression, L{x\Q) is the likelihood function and 7r(^) is the prior probability 
density associated with the parameters ^, reflecting the state of knowledge of 9 before the 
measurement. 



3.1 Inequalities included as priors 

Let us suppose now that we consider an observable Z whose experimental value is Zexpi^z 
and its true value is z. We assume that the values of measurements of Z are distributed 
according to a Gaussian distribution 



1 



27rcr. 



exp 



(16) 



around the true value. Suppose further that from some theoretical consideration we have 
the knowledge that the true value z is bounded by 



a < z <h . 



(17) 



We conceive the true value which is otherwise unknown, as a parameter in our scenario 
and assign to it a prior probability density 



Q{h-z)Q{z-a), 



where denotes the Heaviside function. Due to lack of further knowledge, we have as- 
sumed a fiat prior probability density. Since we are not interested in a posterior probability 
density in the parameter z we perform the integral 



y" dzLz{z)'Kz{z) 



with 



2(6 - a] 



erf 



"cxp 



V2 



+ erf 



"Cxp 



V2 



where we have made use of the error function defined by 



erf (z) = —= 

\/n Jo 



dt e 



(19) 
(20) 

(21) 
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The function (^) represents then the relevant factor in the posterior probabihty density 
which takes into account the inequahty (p!7|). 

To check if we have been lead to a meaningful expression (^OD, we want to discuss the 
behaviour of this function. Following from erf (oo) = —erf {—oo) = 1, we find that for 
a <^ Zcxp ^ 6 we have £^ ~ 1/(6 — a) to a very good approximation, and for z^xp ^ 6 or 
-Zexp -C a we have £a — 0. In this discussion, "much smaller" or "much larger" is defined 
in units of cx^. If we assume that becomes negligibly small, the function iz approaches 
a step function with 1/(6 — a) being the height of the step. The edges of the step are 
smoothened out by a finite o"^. Thus, we will have a maximal contribution to the posterior 
probability density for Zexp well inside the interval [a, b], whereas for Zexp well outside the 
interval [a, b] the function iz is very close to zero. Thus we can be confident that the 
inequality (|l^ is reasonably well taken into account by our procedure. 



3.2 Inequalities treated with a maximum likelihood method 

Again we depart from Eqs. (|1^) and ([T7|). Now we take into account our lack of knowledge 
about the true value of Z by maximizing Lz as a function of z E [a, b]. It is easy to check 
that one obtains 



max Lz = Uz 

2G[a,b] 



exp 



"cxp 



Q{zcxp -b) + 



a — z, 



exp 



0(a - Zcxp) 



■ (22) 



In Appendix ^ we will discuss how this method is related to the method in the previous 
section. 



3.3 The treatment of the CHOOZ result and the atmospheric 
up-down inequality in our statistical approach 

The CHOOZ experiment is a long-baseline z/g disappearance experiment. It measures the 
survival probability Pch, for which we derive the inequality 

PCH = 1 - 2 4(1 - 4) - 2|f/e3|'(l - 4 - \UeZ?){l ' COS^atm) < 1 " 2 4(1 " 4) • (23) 

We have used the abbreviation 0atm = ^"^atm-^/2-E- We conceive Pch in Eq- (il) as the 
true survival probability, as opposed to the experimental value -Pch' ~ 1-01 with the error 
o"cH = 0.039 p2|]. Thus we have the range 

< Pch < 1-24(1 -4)- (24) 

Making the substitutions 

a->0, 6^1-24(1-4), 2; ^ Pch, ^^exp ^ ^cih ' o"^ ^ o"ch , (25) 

the CHOOZ result can be included in the statistical analysis according to both methods 
described in the previous subsections. 
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For the atmospheric up-down inequahty we substitute 

a -G, H, z ^ Aud, ^oxp ^uT' = o-A , (26) 

where G, if, A^^l and a a are given by Eqs. (p!2D , (|T3|) , (H) and (|^), respectively. Notice 
that, since we have A^^^ <^ and H > 0, the first term in the exponential of the expression 
(p^) does not contribute here, and the first term in the expression pO| ) is 1 for all practical 
purposes. 

The substitutions (pSj) and ( pG]) allow us to define - according to Eqs. (|1^), (|T8|), (pOD, 
(R^) - the functions Lch, ttch, ^ch, and L 

-^ud5 referring to the CHOOZ 

experiment and the atmospheric up-down inequality, respectively. These functions will 
be used in the following discussions. 



4 A bound on the LSND ^^l^^^e transition amplitude 
4.1 The statistical procedure 

Let us now describe how to derive our desired probability distribution. We concentrate 
on the four parameters de, d^, A^^d and Pch- We want to stress again that the latter 
two quantities are conceived as true values. Therefore, they are parameters within our 
procedure and we will treat them according to the methods described in Section |^, in 
order to arrive at a distribution solely in d^ and d^. The likelihood function is given by 

L = Loscide, d^) X Lud(Aud) X Lch(^'ch) , (27) 

where the first factor Lose is the product of the likelihood functions of the Bugey, CDHS 
and KARMEN experiments. This likelihood function will be discussed in the next section 
and in Appendix 0. For the treatment of parameters other than d^, and c?^, which appear 
in the fitting procedure to the SBL experiments, see also Appendix |B[ 

The physically allowed region IZd of de and c?^ is described by the inequalities 

7^rf : cie > 0, rf^ > and + < 1 . (28) 

In order to incorporate it into our procedure, we define a function R{dei d^) such that 
R{de, d^) = 1 for {de, d^j) G TZd and otherwise. This function has thus the task of a 
prior which confines {de-, d^) to the physically meaningful region. Adopting the maxi- 
mum likelihood method of Section |3]^ in order to deal with the parameters A^^ and Pch 
and combining this method with Eq. (|T^), we finally arrive at the desired probability 
distribution 

/ 7 \ — Losc{de, d^) L^((je, d^) L^Yiide) R{de, d^j) 

" I dd'^ I dd'^ LUd'e, d'^) LZid'e, d'^) L^d'e) Rid'e, d',)- ^ ' 

The dependence of L^^{de,d^) and L^^^de) on de and d^ comes in through the substitu- 
tions (E6f) and (ESl) of the boundaries a and b. 
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Discussing now the Bayesian approach described in Section 3J, we have the prior 
probabihty density 

7r(4, d^, Aud, Pen) = ^ R{de, d^) 7rud(4, d^, A^^) 7rcH(4, -Pch) • (30) 

We stress that ^ 

j dA^A j dPcR 7r((ie, d^, A^, Pen) = Ride, d^,) (31) 

is fulfilled. This equation tells us that, after integrating over the other variables, the 
prior probability density for and (i^ is uniform. Since these are the variables whose 
distribution we want to calculate, Eq. (^) assures us that with our choice of priors we 
have not introduced a bias in the distribution of dg and d^. 

According to the Bayesian approach in Section ^?T] we perform the integrations 

J dA^^I dPcnL^dLcHTT. (32) 

Finally, we obtain via this method the probability distribution 

/, Losc{de,dfj) i^^d{de,d^) icu{de) R{de,dfj) , . 

^' J dd', J dd'^ Losc(4, d'^) U{d'e. d',) iM) Rid'e, d',) • ^ ^ 

It is important to note that for every Am^ we have such a distribution. The SBL 
mass-squared difference, which is hidden in Lose, is not on the same footing as dg and c?^ 
in our approach. For every given Am^, we find restrictions on d^ and d^ from experiment^ 
which allow us finally to obtain a bound on the transition amplitude A^^-e for any given 
CL. Choosing a CL (3, we find the corresponding bound on A^-e by the prescription 

dde dd^pj{de, d^) = (3 ( j = m, h) . (34) 

For instance, if we choose (3 = 0.99, with Eq. (|3^) we can calculate a number A^gg such 
that Af,.e < ^0.99 at 99% CL. 

The two distributions Pmide, d^) (^9]) and Pb{de, d^) (|33|) are, of course, different func- 
tions of the variables. The method to obtain bounds on A^.^, as given by Eq. ( P^ is the 
same for both distributions. In the following, we will comment on how much the bounds 
on A^.f. calculated with both distributions differ numerically. 

4.2 A qualitative discussion of the SBL data 

As mentioned previously, the SBL experiments are treated with the likelihood function 

Losc{de,dfj) = LBvLgcy{de) X LcDHs('^m) ^ -^KARMEN (^Ai;e) , (35) 

which enters Eq. (^7\j. Here we want to discuss some features of Lose and how these features 
influence the bound on A^;e- Let us start with the Bugey and CDHS experiments. 



■^Note that in the analyses of the Bugey and CDHS experiments Am^ is treated in the same 
way. 
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Both are disappearance experiments and, therefore, the relevant SBL survival probabilities 
are given by 

P..^u^ = ^p.^p. = l-Ad^{l-d^) sin^ , (36) 

where a = e refers to the Bugey and a = /i to the CDHS experiment. Both experiments 
have not found evidence for neutrino oscillations. In the case of the Bugey experiment the 
survival amplitude 4(ie(l — de) is bounded by 0.1 or smaller values in the relevant range 
0.1 eV^ < Am^ < 10 eV^ at 90% CL |23|. Thus, 4 is either very small or close to 1. Since 



for solar neutrinos the inequality 

P^.^.. > dl (37) 
holds , df. must be smallQ and in the fit of the Bugey data we make the approximation 



(ie(l — df.) ~ de in the survival probability. In principle, the inequality (|37|) should be 



included in our analysis with the help of one of the methods discussed in Sections 3.1 and 



3.2, but in view of the smallness of the Bugey survival amplitude this is not necessary. 



In the case of the CDHS experiment, for Am? ^ 0.3 eV^, there is an analogous feature 



concerning ||2^; there, the selection of the small d^ is guaranteed by the up-down 
inequality (|T2D ||lOl. For smaller Am^ the CDHS restriction disappears and values of d 
as large as 0.5 are allowed by the up-down inequality. Therefore, in Lcdhs we do not 
neglect in the survival amplitude because this would not be justified. 

In the KARMEN experiment, — >■ v^. transitions have not been observed and the 
KARMEN exclusion curve [0, ^ cuts right through the region allowed by LSND. There- 
fore, it is important to take into account the KARMEN result in our analysis. For the 
details of our fit to the KARMEN data and the analogous details concerning the Bugey 
and CDHS experiments see Appendix |B[ 

We include the CHOOZ result in our analysis for Am? > 0.05 eV^, where the bound 
on sin^ 29 in the CHOOZ plots is a straight line ||2^; this guarantees that oscillations with 
the SBL Am^ are averaged out and hence Eq. (^) is valid. The CHOOZ result has an 
effect on the A^-e exclusion curve mainly for Am^ where the Bugey bound on de is not so 
strong, which is the case for Am^ around 0.1 eV^ and Am^ ^ 5 eV^. 

4.3 The bound on A^-e 

Fig. |I| represents the main result of this paper. In this figure we show the regions in the 
Am'^-A^-e plane allowed by LSND at 90% and 99% CL p and our exclusion curves for 
A^-e with (3+l)-mass spectra at 90%, 95% and 99% CL. These exclusion curves have been 
calculated using the maximum likelihood approach of Section |3.2| for the treatment of the 
true values A^d and Pen- This method gives - for most values of Am^ - slightly weaker 



bounds than the Bayesian approach of Section |3.1| ; however, the numerical difference 
between the two methods is always smaller than 4%. We read off from Fig. |I] that the 
99% CL LSND region has no overlap with the allowed region to the left of our 95% CL 
bound. This shows that the likelihood of (3+l)-mass spectra is not very high. Comparing 
the 99% CL exclusion curve with the 99% CL LSND region and confining ourselves to 

''We want to stress that this is the only place where solar neutrino data enter our analysis. Moreover, 
our inference that de must be small is independent of the actual solution to the solar neutrino problem. 
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Figure 1: Upper bounds on the transition amplitude A^.g in the case of (3+l)-mass 
spectra for 90%, 95% and 99% CL. These bounds have been calculated with the maximum 



likelihood approach for the inclusion of the atmospheric up-down inequality (12) and the 
CHOOZ inequality ( p3D as described in Section p.2| . Also shown are the regions allowed 
by the latest LSND results || at 90% and 99% CL. 

Am^ < 10 eV^, we find overlaps at Am^ ~ 6, 1.7, 0.9 and approximately between 0.25 
and 0.4 eV^. This agrees with the findings in Ref. where 90% exclusion curves and 
the bound on A^.g derived in Ref. are compared with the 99% CL LSND region. The 
result of the inclusion of the CHOOZ result for Am^ > 0.05 eV^ can be seen as a jump in 
our exclusion curves. From this jump the effect of the CHOOZ result can be read off for 
small mass-squared differences. Let us stress once more that in our analysis an exclusion 
curve for a given CL is the result of a well-defined statistical procedure and is obtained 
by including all available data other than the LSND data; such exclusion curves have a 
precise statistical meaning; an overlap of the 99% CL LSND region with the region to the 
left of an exclusion curve occurs only with the exclusion curve at 99% CL, but not at 95% 
CL. 

There are claims in the literature that all three indications in favour of neutrino 
oscillations are compatible with three neutrinos |2^. Such claims have been refuted by a 
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combined fit to the data [0 . In our analysis we arrive at the same conclusion, because our 
treatment of the (3+l)-spectra is also applicable in the case of three neutrinos, where one 
has (2+l)-mass spectra, since there is a SBL mass-squared difference Am^ and another 
mass-squared difference much smaller than Am?; assuming that is the mass separated 
from the other two by the LSND mass gap, we have to make the identification da = \Uaz\^ 
[a = e,/i). The values of Am^ and Af^-e, indicated in the papers of Ref. |29] as preferred 
solutions, lie in the region allowed by LSND at 99% and thus beyond our 95% CL exclusion 
curve in Fig. ^ 



5 The (2+2)-neutrino mass spectra 



If we want to treat the (2+2)-neutrino mass spectra with the method discussed in the 
previous two sections, the situation is more involved. In this case the — > transition 
amplitude is given by P] 



j=3,4 



and cannot be expressed by 



E \UaA 

j=3A 



{a = e,fj,) 



{31 



(39) 



as in the case of the (3+l)-spectra (see Eq. (^). This suggests to perform an analysis 
with the five parameters de, d^, A^.^,, ^ud and Pen in the case of the (2+2)-spectra. 

Let us explore in more detail the relationship between the amplitude A^.g and the 
parameters de and d^. From Eq. (|38|) , using the Cauchy-Schwarz inequality, we readily 



obtain the inequality H, 31 



A^-e < 4min [ded^, (1 - de){l - d^ 



(40) 



This inequality implies that for every A^.g the following region is allowed in the df.-d^ 
plane: 



1(1 



I- A,, 



< 4 < i(i 



I -A, 



A/.;e/44 < d^ < I- A^.jA{l-de). 



(41) 



For every A^.f. between and 1, this is a region in the unit square, confined by two 
hyperbolas. Let us label the neutrino masses such that Am^^ = Aml^^ and Am^g = 
^"^soiar- Then, with the definitions (§^), Eqs. (^ and (|Tip hold also for the (2+2)-mass 
spectra and we obtain the inequalities 

-A <r'(d d A ) jl -d,f + A,.jAr 

and 

A^, < H (4, d„ A,,e) - Y^J^JY^JJ^JIIj^^ 



(42) 



(43) 
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Figure 2: The upper bound on the transition amphtude A^.^, in the case of (2+2)-mass 
spectra for 90% CL calculated with the probability distribution (^Sj). Also shown are the 
90% and 99% CL level regions of LSND of Ref. H, and the Bugey and KARMEN bounds 
referring to 90% CL as given by our reanalysis. 



for the atmospheric up-down asymmetry. Furthermore, the survival probability for solar 
neutrinos is bounded by P®^_^i^^ > |(1 — deY- Therefore, is close to oneQ and we make 
the approximation de{l — d^.) ~ 1 — (ig in the Bugey survival amplitude. Note that the 
CHOOZ inequality (|23|) also holds for the (2+2)-spectra. 

In analogy to Eq. ( p4D in the (3+l)-case, our aim is to obtain a probability distribution 
in A/i;e- Here we confine ourselves to the maximum likelihood method of Section |3.2| for 
the treatment of inequalities. In addition to the up-down and CHOOZ inequalities we 
have to take into account Eq. (|4l|) . According to the method of Section |3.2| , we maximize 
with respect to A^^, -Pch, d^ and d^. The maximization with respect to the first two 



variables leads to the functions L'J^ and Lq^, which are defined in Section p.3| . The 



^If de is small, then it follows that P®^^ ^ 0.5, which is in disagreement with the result of the 
Homestake experiment (see first paper in Ref. [^); moreover, for small we obtain the same bound on 
A^:e as for the disfavoured (3+l)-mass spectra. 
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prime on the first function indicates tliat now it is obtained from L'^^ by the replacement 



G ^ G' and H ^ H'. Generahzing the method of Section |3.2|, we define 



L'{A,,,) = m^Dc L;,, L'Z ^ch , (44) 



where L'^^^ is given by Eq. (pSf), but in view of the appearance of A^.g in Lkarmen it is 
interpreted as a function of three variables. Finally, we obtain the probability distribution 
for A^-e given by 

^""^ IdA'^.,^L'{A'^.je{A'^.JQ{l-A'^.^^)- ^ > 



In Fig. the 90% CL bound on A^-e calculated with the distribution ( |i5| ) is plotted. 
In this figure the 90% and 99% CL level regions of LSND are also depicted. The region 
to the left of the bound has an overlap area with the LSND region of 90% CL. This 
shows that the (2+2)-spectra are well compatible with all data. Also shown in Fig. |] 
are the KARMEN and Bugey exclusion curves. As expected, for large Am^ the solid 
line of our exclusion curve follows rather well the KARMEN exclusion curve, whereas for 
small Am^ it tends to follow the Bugey curve. Due to the inclusion of the CHOOZ result 
above 0.05 eV^, the solid line is more restrictive there than the Bugey curve, whereas 
below 0.05 eV^ both curves are nearly identical. We have also investigated the exclusion 
curve of the (2+2)-spectra within the Bayesian approach to inequalities of Section ^.1[ In 
this approach we have more freedom to make "reasonable" choices for priors than in the 
(3+l)-case, and, numerically, the Afj_-e bounds tend to be a little more restrictive than the 
solid line in Fig. El. 



6 Conclusions 

In this paper we have examined the (3+1) and (2+2)-classes of the 4-neutrino mass spec- 
tra within a rigorous statistical analysis. Since we do not have sufficient information 
concerning the final LSND data 0, we have chosen the approach to analyse all other 
available data and compare our result with the LSND result in a Am^-A^^e plot. This 
approach suggests to extract that information from the solar and atmospheric data which 
is most relevant for SBL oscillations with respect to Am^. This extraction is most appro- 
priately done in the form of inequalities involving elements of the neutrino mixing matrix 
IP, 1^, |l^. Similarly, we have extracted the "SBL information" contained in the CHOOZ 
result. On the other hand, concerning the SBL experiments, we have fully included the 
data of the Bugey, CDHS and KARMEN experiments. 

Since our aim has been to incorporate in the statistical analysis the atmospheric up- 
down inequality, Eq. (|1^) or (0), and the CHOOZ inequality (0), we have made use of 
the likelihood function in combination with the Bayesian approach to probability which 
allows us to derive probability distributions of the parameters which are to be estimated. 
In this context we have presented two possibilities for including inequalities involving 
parameters: one way is to treat them in the form of prior probability densities for which 
a "reasonable choice" has to be made; another way is a kind of maximum likelihood 
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treatment. Numerically, we have compared both methods for exclusion curves in the case 
of the (3+l)-spectra and found that the difference is negligible. 

With the method described in the paper we have obtained for every Am^ a probability 
distribution for the SBL transition amplitude A^^-e, from which we could derive bounds 
as a function of Am^ on this amplitude for any CL. The results are shown in Figs. |l] 
and § for the (3+1) and (2+2)-neutrino mass spectra, respectively. In the latter case our 
90% CL exclusion curve is close to the KARMEN exclusion curve down to Am^ ~ 0.5 
eV^; there it turns off and starts to come close to the exclusion curve given by the Bugey 
data. Thus, for the (2+2)-spectra our method reproduces more or less what one obtains 
by naively comparing the KARMEN and Bugey exclusion curves with the region allowed 
by LSND. Therefore, these spectra are well compatible with all the data. On the other 
hand, in the case of the (3+l)-spectra, our 95% CL bound has no overlap with the LSND 
region of 99% CL. We, therefore, come to the conclusion that this spectral class is rather 
unlikely, even with the recent change in the LSND region. 

Thus we strengthen with the method presented here the claims made in Refs. p, ^, |Ty| . 



Should the LSND result be confirmed by the MiniBooNE Collaboration |32], then, in a 



4-neutrino scheme, the sterile neutrino should make its appearance either in the solar or 
atmospheric neutrinos, or both. 
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A The relationship between the Bayesian and the 
maximum likelihood methods for the treatment 
of inequalities 

Here we want to elucidate the relationship between the methods for the inclusion of 
inequalities introduced in Sections ^TT] and |3.2| . In the Bayesian approach to this problem 



we consider in general integrals of the type 

= [' dzLziz)n{z) , (46) 

Ja 



where Lz is given by Eq. A prior vr is a positive and piecewise continuous function 

such that Jl^dz7T{z) = 1. In Section ^J] we have used the flat prior (0). If we denote 



the set of all prior probability densities on the interval [a, b] by V, then the following 
proposition holds. 

Proposition: For the integral in Eq. (H3) one has the upper limit 



ma^/[7r]=L-, (47) 
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where is given by Eq. (22). 

Proof: The proof is very straightforward. Let us first assume that Zexp > h. Then we 



have 



I['K]<Lz{h) f dzn{z) =Lz{b). 

J a 



Thus we have found an upper bound on /. If we can find a sequence of TCk of prior 
probabihty densities such that 

hm /[vTfc] = Lzib) , 

then the proposition is proven for the case z^^p > b. Such a sequence is easy to give: any 
sequence iik, for which TTk{z) = foi z < b — 1 / k holds, fulfills our purpose. For Zgxp < cl 
we proceed analogously. If z^^p G the upper bound on I is Lz{zexp)- The sequence 

TTfc is constructed accordingly with the idea given before. Thus for the three cases Zgxp > b, 
Zexp < 0, and z^^^ G [a, b] we have the upper limits Lz{b), Lz{a) and Lz^z^xp), respectively. 
In summary, we just have obtained the expression (^). Q.E.D. 

Thus the expression is obtained from the Bayesian approach as the maximum over 
all possible priors. Sloppily speaking, the prior in /, which gives L^, is a delta function 
{6{z — b), 6{z — a) or 6{z — Zexp))] however, in order to choose the correct delta function one 
has to know the experimental value Zgxp and, therefore, such a function does not deserve 
the name "prior" anymore. Though iz < holds, it is not obvious which method 
gives the stronger constraint in an actual situation, because one has additional factors 
in the probability distribution one aims at, coming from additional data, and one has to 
normalize the combined distribution (see Eq. (p!5|)). Moreover, the bounds a and b are in 
general functions of the parameters whose distribution we want to know. In the concrete 
situation discussed in Section ^ the maximum likelihood method represented by gives 
a slightly weaker restriction on the transition amplitude A^^-e for most Am^. 



B The analyses of the Bugey, CDHS and KARMEN 
experiments 

In this appendix we describe how the data of the SBL experiments Bugey, CDHS and 
KARMEN is included in our analysis. We use as much information as can be recovered 
from the publications of the experimental groups to perform a fit to the data. The fact 
that we can reproduce the published 90% CL bounds in the case of 2-neutrino oscillations 
to a good accuracy inspires confidence in our analysis. 



B.l Bugey 



The Bugey experiment ||2^ searches for u^, disappearance at the three distances 15 m, 
40 m and 95 m away from a nuclear reactor. The electron antineutrinos are detected 
through the reaction Ue + p —>■ + n. As input data for our analysis we use Fig. 17 of 
Ref. where the ratios of the observed events to the number of expected events in case 
of no oscillations are shown for the three positions in bins of positron kinetic energy in 
the range 1 MeV < < 6 MeV. 
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For the analysis we follow Eq. (9) of Ref. 



23 



and use the x^-function 



\2 



=1 ^ji 



Here j = 15, 40, 95 labels the three positions, i the positron energy bins and A^is = 
A^40 = 25, Ng^ = 10 are the numbers of bins at each position. For Eji we take the 
mean positron energy in bin ji. -R^^^ is the ratio of measured to expected events in each 
bin with its statistical error aji, both read off from Fig. 17 of Ref. ||2^. is the 

theoretical prediction for this ratio in the case of oscillations, depending on the oscillation 
parameters, and we set i?*^*^" = {Pp^^pjji, where Pp^-,ue is given in Eq. (p6|). Various 
systematic uncertainties are taken into account by minimizing the x^ Eq. (||), with 
respect to the five parameters A, aj and b for given oscillation parameters. In Ref. 
the values = 4.796%, cr^ = 1.414%, at = 0.02 MeV"^ and = 1 MeV are given. 

To perform the averaging of the survival probability we estimate the uncertainty in the 
flight length of the neutrinos because of the size of the production region and the detector 
to 3 m and we assume that the flux varies with the distance as L~^. In the relevant 
energy range antineutrino and positron energy are related by E^, = Ee+ + 1.8 MeV to 
a very good approximation. For the purpose of averaging the survival probability over 
the energy range in one bin it is a good approximation to take neutrino flux, detection 
cross section and efficiency as constant with energy. The reason for this is that the 
energy bins are relatively small and only ratios of observed to expected events in each bin 
are considered. Furthermore, we assume a Gaussian resolution function for the positron 
energy measurement with variance 0.4 MeV. 

The likelihood function in Eq. ([35| ) which contains the information of the Bugey ex- 
periment is obtained from the of Eq. (|48|) by |pl 



^Bugey(4) OC CXp ("^X^) • (49) 

The 90% CL bound on de obtained from this likelihood function alone can be compared to 
the Bugey exclusion curve in the 2-neutrino case with the identification sin^ 26'Bugey — 4(ie- 
The curve obtained by our analysis is shown in Fig. ^ and compares well with the originally 
pubhshed one ||23[| . 

In Eq. (^) contributions of oscillations because of Aml^^ to the SBL disappearance 
amplitude are neglected. This approximation may not be exactly fulfilled in the Bugey 
experiment for small Amg^L and large Aml^^. We have calculated the 90% CL bound 
from Bugey by taking into account also oscillations with Am^^j^ = 6 x 10^'^ eV^, which is 
the 99% CL upper bound on Aml^^ flSl, and find that for Amg^L > 0.04 eV^ the effect 
is smaller than 6%. 



B.2 CDHS 



25 searches for u,. 



The CDHS experiment 
events in 

-^front = 130 m, respectively, from the neutrino source 



disappearance by comparing the number of 
the so-called back and front detectors at the distances Lback = 885 m and 

The neutrinos are detected via 
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100 






Figure 3: The 90% CL bound on sin^ 26'cdhs given by our reanalysis of the CDHS exper- 



iment as described in Section B.2 



muons produced in charged-current interactions. The data is given in form of the double 
ratios 

jy -^back /-^front /e.r\\ 

-^corr = atMC / ATMC ' V"^^'' 
^^back/^^front 

where A^back (Affront) is the number of observed events in the back (front) detector and 
A^,^^ and A^f^nt the corresponding quantities expected for no oscillations calculated 
by Monte Carlo. 

The ratios (0) are given in 15 bins of "projected range in iron" . This is the distance 
traveled by the muon in the detector (consisting of iron) projected onto the detector axis, 
which has an angle of 22° relative to the neutrino beam axis. We calculate the range in iron 
r{Efj) of a muon with energy by integrating Eq. (23.1) of Ref. [^. The muon energy 
intervals [E'^^\ ^j^'^^] corresponding to the intervals of projected range (^proj) for bin i given 
in Table 1 of Ref. [^] are obtained by applying the relation rproj (-E^) — ^{E^) cos d cos 22°, 



where ^ ~ 20° is the average scattering angle of the muons 

We estimate the number of events in bin i and at position p = back or front using 

AT,, oc mJ dE, dEj dLL-'P.^^^^ {L/E^ME,) . (51) 

JEfj^ J Ef_i J Lp~ALp/2 U-C/^ 

Here Mp is the detector mass at position p. Taking into account the size of the decay 
tunnel (52 m) and the length relevant for detection in the back/front detector (72 m/22 m) 
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1 25 1 we have ALback = 52 + 72 m and ALfront = 52 + 22 m. The disappearance probabihty 
Py^^u^{L/ Ey) depending on the oscillation parameters is given in Eq. ( p6[ ) and ctdis is 
the cross section for the deep inelastic scattering process + N ii + X (see, e.g., 
Ref. |3^). The neutrino flux ^{E^) in the relevant neutrino energy range E^, ^ 0.7 GeV is 
proportional to exp(— GeV) [|^, Finally, we obtain for the theoretical prediction 
for the double ratios f^Ol) in bin i 



R: 



theo 



iback 



L 



back \ 



^ifront \L 

front 

and we define the CDHS likelihood function by 



M, 



J M, 



front 



back 



(52) 



LcDus{d^) oc exp 



X!(-^corr -^theo)('S' ^)ij{RioTT ^ 



theo ) 



(53) 



Assuming total correlation between any two bins, the covariance matrix is given by Sij = 
Sijaf + cTgyg^. -Rcorr Statistical error cij are read off from Table 1 of Ref. |]25|. The 

overall systematic error in the ratio of event rates in the two detectors was estimated to 

^syst 

2.5% in Ref. |2|. 

The 90% CL bound on sin^ 2^^cdhs = 4(i^(l — d^) obtained by our analysis is shown in 
Fig. ^. It is very similar to the bound published by the CDHS collaboration [^. There 
are minor differences for small mass squared differences, which could have some effect 
for our bound on A^.f, in the region 0.2 eV^ ^ Am^ ^ 0.4 eV^: our bound disappears at 
Am^ ~ 0.3 eV^, whereas the CDHS bound extends down to approximately 0.24 eV^. 



B.3 KARMEN 

The latest data of the z/^ —>■ z/g oscillation search in the KARMEN experiment is presented 



in Ref. |2^. Analysing the data taken from February 1997 to March 2000 they find a 
total of 11 candidate events, in good agreement with the expected number of background 
events for no oscillations of 12.3 ± 0.6. For our analysis we use the data resulting from 
the detection process z/g + p e"*" + n. The positron spectrum S{Ef,+ ) expected for 
A^,e = sin2 2^KARMEN = 1 and Am^ = 100 eV^ we take from Fig. 2(a) of Ref. |2|. 



To estimate the number of events in a positron energy interval [Ei,E2\ resulting from 



neutrino oscillations we follow Eq. (Bl) of Ref. |3^ 

rE2 rL2 



iV°- = N f ' dEe+ S{E,+ ) f ' dLL-^P,^^,^{L/E,) , (54) 

JEi JLi 

where the oscillation probability Pp^^ue is given in Eq. (H). For L12 "we take 17.5 + 1.75 



m 



35[| and antineutrino energy and positron kinetic energy are related by E^ = Ef,+ + 1.8 
MeV. The normalization factor is fixed by requiring that for the total positron energy 
range Ei = 16 MeV, E2 = 52 MeV, full mixing (sin^ 2^karmen = 1) and Am^ > 100 eV^ 
the number of events resulting from oscillations is 2442 (see Table 1 of Ref. P7| ' 



From Fig. 2(b) of Ref. we read off for each of the 9 positron energy bins the number 
of observed events N°^^ and the number of background events expected for no oscillations 
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Bi. Then we construct the hkehhood function by using the Poisson distribution: 



LKAnuMA,,) = n i(^r + Br^'e-(^r^^^ . (55) 

i=l ^^i ■ 

Here N"^'^ is calculated from Eq. by choosing Ei and E2 according to the bin i. The 
90% CL bound on A^.g for a given Am? obtained from the probability distribution implied 
by Eq. ( |53| ) in the Bayesian approach is shown in Fig. ^ Our bound is very close to the 
one presented in Ref. . 
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